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REMARKS/ARGUMENTS 

The Applicant thanks the Examiner for the Official Action dated May 19, 2004. In response 
to the issues raised, we offer the following submissions and amendments. 

Amendments 

To overcome the Examiner's objection to the specification filed on October 20, 2000, the 
Applicants now enclose a substitute specification. Also enclosed is a marked-up copy of the 
substitute specification. 

The claims have also been amended to clarify the features distinguishing the invention from 
the prior art. 

We submit that the amendments do not introduce any new matter. 

Drawings 

The drawings and detailed description have been amended to address the deficiencies 
identified by the Examiner. We submit that the drawings now comply with 37 CFR.§ 
1.84(p). 

Claims - 35USC§102 

The Applicant submits that US 6,603,864 to Matsunoshita fails to anticipate amended claim 
1. Amended claim 1 clarifies that the coded data relates to the visible image depicted on the 
photograph. The scanner reads and decodes the embedded data so that the inkjet printer can 
print the image. 

In contrast, Matsunoshita stores information such as copyright details in the embedded data. 
Matsunoshita reproduces the visible image by scanning the original image with visible RGB 
image sensors. Any damage or deterioration of the original image is captured by the scanner 
and transferred to the new image (together with the copyright details from the invisible 
coded data). 

The Examiner argues that Matsunoshita discloses digital encoding of image data within the 
image (column 8, lines 22-29). The Applicant strongly disagrees. Matsunoshita teaches 
away from encoding image data in IR ink. All of Matsunoshita' s embodiments describe the 
coded data as appended to the image data. Likewise the summary of the invention and 
claims in Matsunoshita make it clear that the coded data is additional to the image data. 
Furthermore, none of the Matsunoshita embodiments teach a method of encoding enough 
data to reproduce a photographic image. In fact, Matsunoshita explicitly teaches limiting the 
amount of data encoded by IR ink so as to avoid the degradation of the image quality. 
Ordinary workers would readily appreciate that Matsunoshita relates only to encoding 
copyright ownership details, website addresses, image labeling or the like. Encoding the 
high volume of data needed to reproduce the image has not been contemplated by 
Matsunoshita. 
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The present invention does enable the reproduction of the image from the embedded digital 
data. The original visible image is digitally recorded so any fading or damage in the original 
image does not carry over to the visible image printed by the printer. This system also 
easily facilitates the incorporation of addition effects in the reproduced image, such as that 
taught by Matsunoshita. 

From a fair reading of the specification as a whole, ordinary workers in this field would 
understand that this feature is the primary advantage of the present invention over the prior 
art. Matsunoshita fails to recognize the problem of image deterioration or teach the solution 
provided by the present invention. 

As claims 2-5 are directly or indirectly appended to amended claim 1, they are likewise 
novel in light of the Matsunoshita disclosure. 

Claims - 35USC§103 

Claim 2 and 5 stand rejected as obvious in light of Matsunoshita in view of US 5,771,245 to 
Zhang. The Applicant submits that the cited references fail to support an obviousness 
objection. 

It is well established that 35USC§103 requires that the citations teach or suggest all the 
claim limitations. Neither of the citations allude to recording the image as digitally encoded 
data embedded in the visual image. In fact, as discussed above, Matsunoshita teaches away 
from encoding the image data. It follows that the skilled worker would not derive the 
present invention from the cited references as a mere matter of routine. 
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The Applicant respectfully submits that the claim rejections have been successfully 
traversed. Accordingly favorable reconsideration and allowance of the application is 
courteously solicited. 



Very respectfully, 



Applicant: 



KIA SILVERBROOK 



PAUL LAP STUN 



SIMON ROBERT W&LMSLEY 



C/o: 



Silverbrook Research Pty Ltd 

393 Darling Street 

Balmain NSW 2041 , Australia 



Email: kia.silverbrook@silverbrookresearch.com 
Telephone: +612 9818 6633 
Facsimile: +61 2 9555 7762 




TITLE OF THE INVENTION 



DIGITAL PHOTOGRAPH DUPLICATION SYSTEM WITH IMAGE QUALITY 
RESTORATION 



5 FIELD OF THE INVENTION 

The present invention relates to an apparatus for printing out or duplicating 
photographs from information recorded in infrared ink on the top of the photograph using an 
ink jet printing system. 



10 



CO-PENDING APPLICATIONS 



Various methods, systems and apparatus relating to the present invention are disclosed 
in the following co-pending applications filed by the applicant or assignee of the present 
invention simultaneously with the present application: 



US Patent Application Serial Number 
(which would be filed in at a later date, when the number is 

received) 



X 



Docket No. 



09 /693.47N 



ART80US 



09 /693.083- 



ART81US 



09/693.134- 



ART82US 



09 /693.226- 



ART83US 



09/693.277- 



ART 84 US 



1 5 The disclosures of these co-pending applications are incorporated herein by reference. 

Various methods, systems and apparatus relating to the present invention are disclosed 
in the following co-pending application filed by the applicant or assignee of the present 
invention on 10 July 1998: 

USSN 09/1 12,781 (Docket No. DOT01US) 
20 USSN 09/1 1 2,785 (Docket No. ART29US) 

USSN 09/1 12,824 (Docket No. ART33US) 

The disclosures of these co-pending applications are incorporated herein by reference. 
Various methods, systems and apparatus relating to the present invention are disclosed 
in the following co-pending applications filed by the applicant or assignee of the present 
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invention on June 30, 2000: 

USSN 09/608,308 (Docket No. CPE01US) , 

USSN 09/608,77 9 (Docket No. CPE02US) 

USSN 09/607,987 (Docket No. CPE03US) 
5 USSN 09/608,776 (Docket No. CPE0 4 US) 

USSN 09 /607.250— (Docket No. CPE05US) 

USSN 09/607,991 (Docket No. CPE06US) 
The disclosures of these co-pending applications is incorporated herein by reference. 

10 BACKGROUND OF THE INVENTION 

The applicant has previously described in USSN 09/1 12,785 (Docket No. ART29US) 
method and apparatus for printing out images using an ink jet printing system on a print media 
using a pagewidth ink jet printhead. The image can also be transformed by an image 
processing program loaded into the camera system for providing various effects on the image. 

1 5 The applicant has also disclosed recording data on the back of a printed photograph which can 

be used to reprint or recover the image which is printed on the front of the print media sheet. 
Such a printing system requires that there are two printheads one for printing the image itself 
and one for printing the data in an encoded fault tolerant form on the back of the photograph. 

In applicant's USSN 09/1 12,824 (Docket No. ART33US) , a method and apparatus for 

20 reproducing a photograph for example, printed using a camera system such as disclosed in 

USSN 09/1 12,781 (Docket No. DOT01US) or USSN 09/1 12,785 (Docket No. ART29US) is 
disclosed. 

In EP 354,581, a music score is encoded as a matrix of dots along a margin on a sheet 
and the data is read by a linear scanner. The scanner reads the width of the matrix which is 

25 much less than the width of the music score sheet. The amount of data encoded and therefore 

requiring processing is limited. Eight rows of binary data are used to record the music score in 
a 12 row matrix. The scanner is hand held and reading the data can result in errors if the angle 
of the linear scanner is too large such that the width of the scanner does not fully cover the 
width of the matrix. The invention disclosed in EP 354,581 has limited use and the disclosure 

30 does not suggest itself to use with a credit card size data card (e.g. 55mm x 85mm) as 

disclosed in USSN 09/1 12,781 (Docket No. DOT01) . 

In the article, "Optical Sheet Memory System", Shinji Ohyama, Electronics and 
Communications in Japan, Part 2, Vol. 75 No.4, 1992, pp 73-85, a system for recording a 
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number of images and a duration of sound on a postcard size sheet using printed dots is 
disclosed. Postcards are mass-produced using a "precision printing method" the substance of 
which is not described. This system while similar to applicant's USSN 09/1 12,785 (Docket 
No. ART29US) or USSN 09/1 12,824 (Docket No. ART33US) does not provide for a portable 
5 on-demand print imaging system nor does it provide an output with both a viewable image and 

an encoded recoverable form thereof. The postcard is unusable without a data reader. 

The applicant has disclosed in co-pending applications USSN 09 /693.471 — 

(Docket No. ART80US) , USSN .09/691,083 (Docket No. ART81US) and USSN 

09 /693JJ34 (Docket No. ART82US) filed concurrently herewith, methods for 

10 recording data relating to an image captured by a camera system on top of or coincident with 

the printing of the image itself, that is, the image and the data are recorded on the same side 
and in the same area of the print media. Such a method requires a pagewidth ink jet printhead 
having at least four ink jet nozzles per printed "dot", three for printing the color image namely 
for printing with cyan, magenta and yellow inks and one for printing with an infra-red ink for 

1 5 printing the data corresponding to the image after it has been processed into an encoded fault 

tolerant digital form. 

SUMMARY OF THE INVENTION 

The present invention seeks to provide an apparatus for decoding the data printed on a 
20 photograph and printing out an image decoded from said data on a print media. The data 

printed on top of the image may be a digital representation of the image itself in an encoded 
fault tolerant digital form, or the image so encoded and an image processing program for 
producing a particular effect upon the image, or two images, one being the image per se and 
the other being the image as transformed by an image processing program. In the former case 
25 the image itself can be printed out notwithstanding substantial damage to the print media upon 

which the image and the encoded image data is recorded. In the second case the image can be 
printed out in its original form or as modified by the image processing program recorded along 
with that image data. In the third case either the image per se or the image as transformed can 
be printed out. The data which is recorded on the photographic image is encoded in such a 
30 way that even if substantial damage occurs to the surface of the photograph, the data will 

allow recovery of the image. This is possible by suitable duplication and redundancy in the 
data compression and scrambling of the data and encoding the data in a fault tolerant, for 
example a Reed-Solomon, code form. The size of the photograph is approximately 4" x 6" 
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(102mm x 152mm). The data can be recorded on substantially the whole area of the 
photograph in a variety of formats, one of which is to record it as a series of data blocks (the 
so-called "alternative Artcard" format) and another of which is to record the data continuously 
over the data area as a series of columns (the so-called "Artcard" format) both of which are 
5 described in detail in USSN 09/112,781 (Docket No. DOT01US) or USSN 09/112,785 
(Docket No. ART29US) . The former method of encoding, described in applicant's co- 
pending applications USSN 09/693,471— (Docket No. ART80US) , USSN 
09 /693.083— (Docket No. ART81US) , USSN 09 /693:134 (Docket No. 

ART82US) , would allow recovery of the image even if one third of the data blocks were 
1 0 damaged. Other sizes of print media are also disclosed for example a panoramic print which is 

approximately the same height but twice the width of the standard print 4" x 6" described 
above. 

By having the image data recorded on the image itself the need to have a separate 
photographic negative and to store it along with the photograph is avoided. Presently, the 

15 storage of image data in a digital form is on a computer system and is subject to the limited 

capacity of the hard drive, the ability to find the data and the risk of damage to the hard drive 
storing the data, the obsolescence of the hard drive, or the obsolescence of the image data 
format. These defects are avoided in the current arrangement whereby the data is recoverable 
if the photograph itself is available, if it has not suffered more than one third damage, that is 

20 approximately two thirds is available for processing. 

It is an object of the present invention to provide for an apparatus of reading digital 
data printed on a photograph in infrared ink wherein the data is encoded image data from a 
camera system, the apparatus including a scanner means for scanning data in infrared printed 
on the photograph; means for advancing the print media through the scanning means; means 

25 for illuminating the print media with infrared radiation; means for processing data output from 

said scanner means including means for decoding said data; ink jet printer means for printing 
out the image derived from said decoded data on a print media attached to said ink jet printer 
means. 

The encoded fault tolerant digital data may also be reprinted on top of the recovered or 
30 replicated image if the ink jet printhead has provisions for printing in the necessary number of 

colors, namely cyan, magenta, yellow and infrared. If the photograph is undamaged then a 
direct copying or replication of the infrared data and/or color image can be produced in the 
manner of the applicant's method and apparatus disclosed in the application USSN 09/1 12,824 
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(Docket No. ART33US) . If the photograph is damaged then the full data would have to be 
recovered before being printed and, if required encoded again into its fault tolerant digital form 
for print out simultaneously with the image on the print media. Other versions of the image 
can also be printed if the apparatus is provided with means for reading an "Artcard" and for 
5 processing the data received therefrom in the manner as described in USSN 09/112,781 

(Docket No. DOT01US) and USSN 09/1 12 5 785 (Docket No. ART29US) by the applicant. In 
this instance, the Artcard reader may be the same device as the photograph scanning means or 
may be a separate integer. An Artcard as disclosed in said applications is of a credit card size 
approximately 55mm x 85mm and the scanning means for scanning a photograph as required 

10 for the present invention would be wider to accommodate the 102mm x 152mm (4" x 6") size 

of the photograph. In that case, the scanner means may be provided with means for 
accommodating various width cards for example, for altering the size of the slot through 
which the Artcard or the photograph is to be inserted. 

The print media used to print out the recovered or duplicated photograph is the same as 

15 the photograph itself namely approximately 102mm x 152mm (4" x 6"), although it is 

contemplated that the print media may be of a larger size such as to provide a panoramic print 
of the same height but approximately twice the width of the standard photograph. A 
panoramic print may require an image processing program to be employed using the 
appropriate Artcard for that purpose or the original photograph may have been a panoramic 

20 print with the encoded data including the necessary image processing program encoded 

therewith, for example as described in the applicant's application USSN 
09 /693.083 (Docket No. ARTS 1 US V 

BRIEF DESCRIPTION OF THE DRAWINGS 

25 Notwithstanding any other forms which may fall within the scope of the present 

invention, preferred forms of the invention will now be described, by way of example only, 
with reference to the accompanying drawings in which: 

Fig. 1 illustrates one form of card reader according to the invention; 
Fig. 2 illustrates an exploded view of Fig. 1; 
30 Fig. 3 illustrates a side perspective view, partly in section, of one form of construction 

of CCD reader unit; 

Fig. 4 illustrates a checkerboard pattern with which the data surface may be modulated; 
Fig. 5 illustrates the reading process; and 
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Fig. 6 illustrates the steps necessary to decode data read in from a photograph. 

DESCRIPTION OF THE PREFERRED EMBODIMENT 

Dots 

5 The dots printed on the photograph are in infrared ink over a color image. 

Consequently a "data dot" is physically different from a "non-data dot". When the photograph 
is illuminated by an infrared source having complementary spectral properties to the 
absorption or response characteristics of the infrared (IR) ink the data appears as a 
monochrome display of "black" on "white" dots. The black dots correspond to dots were the 
10 IR ink is and has absorbed the IR illumination and "white" dots correspond to areas of the 

color image over which no IR ink has been printed and reflecting the IR illumination 
substantially unattenuated or only partially attenuated. Hereinafter the terms black and white 
as just defined will be used when referring to the IR ink dots recording data. 

15 Data Card Reader 

Fig. 1, illustrates one form of card reader 500 which allows for the insertion of a 
photograph 9 for reading. Fig. 2 shows an exploded perspective of the reader of Fig. 1 . The 
card reader is interconnected to a computer system and includes a CCD reading mechanism 
35. The card reader includes pinch rollers 506, 507 for pinching an inserted photograph 9. 

20 One of the rollers e.g. 506 is driven by a motor 37 for the advancement of the photograph 9 

between the two rollers 506 and 507 at a uniform speed. The photograph 9 is passed over a 
series of infrared (IR) LEDs 512 which are encased within an IR transparent mould 514 
having a semi circular cross section. The cross section focuses the IR from the LEDs eg 512 
onto the surface of the photograph 9 as it passes by the LEDs 512. From the surface it is 

25 reflected to a high resolution linear CCD 34 which is constructed to a resolution of 

approximately 4800 dpi. The CCD reader includes a bottom substrate 516 aftd — aand IR 
transparent mould 514 providing a top substrate-5-W. In between the two substrates is inserted 
the linear CCD array 34 which comprises a thin long linear CCD array constructed by means 
of semi-conductor manufacturing processes. 

30 The surface of the photograph 9 is encoded to the level of approximately 1600 dpi 

hence, the linear CCD 34 supersamples the photograph's surface with an approximately three 
times multiplier. The photograph 9 is further driven at a speed such that the linear CCD 34 is 
able to supersample in the direction of photograph movement at a rate of approximately 4800 
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readings per inch. The scanned CCD data is forwarded from the reader to processing unit 3 1 
for processing. A sensor 49, which can comprise a light sensor acts to detect the presence of 
the photograph 439. 

Turning to Fig. 3, there is illustrated a side perspective view, partly in section, of an 
5 example construction of the CCD reader unit. The series of LEDs e.g. 512 are operated to 

emit infrared (IR) radiation when a photograph 9 is passing across the surface of the CCD 
reader 34. The emitted IR radiation is transmitted through a portion of the top substrate 523. 
The substrate includes a portion e.g. 529 having a curved circumference so as to focus IR 
radiation emitted from LED 512 to a point e.g. 532 on the surface of the photograph 9. The 

10 focused IR radiation is reflected from the point 532 towards the CCD array 34. A series of 

microlenses e.g. 534, shown in exaggerated form, are formed on the surface of the top 
substrate 523. The microlenses 533-34 act to focus IR radiation received across the surface to 
be focused down to a point 536 which corresponds to a point on the surface of the CCD reader 
34 for sensing of IR radiation falling on the IR sensing area of the CCD array 34. 

15 A number of refinements of the above arrangement are possible. For example, the 

sensing devices on the linear CCD 34 may be staggered. The corresponding microlenses 534 
can also be correspondingly formed as to focus IR into a staggered series of spots so as to 
correspond to the staggered CCD sensors. The CCD array may only cover a part of the width 
of the photograph being scanned (for example, a half) and a microlens array or other optical 

20 arrangement may be utilized to enable radiation from the full width of the photograph to be 

collected for detection. Suitable linear CCD arrays sensitive to infrared radiation are those 
used in facsimile machines or flat bed scanners. For a description of the construction and 
operation of linear CCD devices, reference is made to a standard text such as in "CCD arrays, 
cameras and displays" by Gerald C Hoist, published 1996 by SPIE Optical Engineering Press. 

25 Further, suitable sensor devices are regularly described in the IEEE Transactions on Consumer 

Electronics. 

To assist reading, the data surface area of the photograph 9 is modulated with a 
checkerboard pattern as shown with reference to Fig. 4. A portion of the data 25 is shown in 
schematic form and the data comprises an array of ER dots which is additionally modulated by 
30 a high frequency "checkerboard" pattern 21 added to the data so as to assist in sensing of the 

encoded data. Other forms of high frequency modulation may be possible however. 

A printer is provided in combination with the scanner for printing out the image data 
on the photograph after it has been read and decoded. For example, the applicant's Artcard 
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reader or an Artcam with an integral Artcard reader as disclosed in USSN 09/1 12,785 (Docket 
No. ART29US) modified to accommodate reading in the infra-red of a wider and longer card 
and to which print means can be removably attached can be used for these purposes. 

A suitable printhead is disclosed in applicant's USSN 09/608,308 (Docket No. 
5 CPE01US) - USSN 09/608,77 9 (Docket No. CPE02US) , USSN 09/607,987 (Docket No. 

CPE03US) , USSN 09/608,776 (Docket No. CPE0 4 US) , USSN 09 /607,250 (Dock et 
No. CPE05US) ,- and USSN 09/607,991 (Docket No. CPE06US) applications, which disclose 
a 6-ink ink jet pagewidth printhead for printing an A4 size page (210mm x 275mm or 8" x 
IVA "). In the current invention the photograph print media may be 4" x 6" (102mm x 
10 1 52mm) requiring a printhead of approximately half the width as disclosed therein. 

Reading Data from the CCD — General Considerations 

In what follows, it is assumed that the data is encoded on a photograph using the so- 
called "Artcard" format as disclosed in applicant's USSN 09/1 12,781 (Docket No. DOT01US) 

15 or USSN 09/1 12,785 (Docket No. ART29US) in a data area of 97mm x 147mm for a 102mm 

x 152mm photograph (4" x 6") with 2.5mm borders (0.1"). In this format the data area is 
continuous and bordered by targets at the leading and trailing edges of the data area and by 
other indicia along the top and bottom margins to ensure correct reading of the data 
notwithstanding up to 1° rotation of the photograph with respect to the linear CCD IR sensor's 

20 orientation. The data is scrambled and encoded using a Reed-Solomon algorithm or process. 

In addition, the data may be compressed before encoding and scrambling. The data may be 
image data from a camera system, image data and an image processing program, or two 
images, one the image as photographed and another an image as transformed by an image 
processing program such as described in applicant's co-pending applications USSN 

25 09/693,471 — (Docket No. ART80US) , USSN 09/ 69^083— (Docket No. 

ART81US) , USSN 09 /693J34 (Docket No. ART82US) . 

As illustrated in Fig. 5, the reading process has 4 phases operated while the pixel data 
is read from the card. The phases are as follows: 

Phase 1 . Detect data area on photograph 

30 Phase 2. Detect bit pattern from photograph based on CCD pixels, and 

write as bytes. 

Phase 3 . Descramble and XOR the byte-pattern 

Phase 4. Decode data (Reed-Solomon decode) 
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The photograph 9 must be sampled at at least double the printed resolution to satisfy 
Nyquist's Theorem. In practice it is better to sample at a higher rate than this. Preferably, the 
pixels are sampled at 3 times the resolution of a printed dot in each dimension, requiring 9 
pixels to define a single dot. Thus if the resolution of the photograph 9 is 1600 dpi, and the 
5 resolution of the sensor 34 is 4800 dpi, then using a 100mm width CCD image sensor 

(98.7mm. is required to cover the width of the data area of 97mm x 147mm with margins of 
2.5mm printed at 1600 dpi print resolution and allowing for up to a 1° rotation of a photograph 
of 4" x 6" or 102mm x 152mm) results in 18900 pixels per column (100*1600*3/25.4). 
Therefore if a photograph stores 8MB of dot data (at 9 pixels per dot) then this entails 
10 8MB*8*9/1 8900 = 30,476 columns or approximately 30,500 columns. Of course if a dot is 

not exactly aligned with the sampling CCD the worst and most likely case is that a dot will be 
sensed over a 16 pixel area (4x4). 

A photograph 9 may be slightly warped due to heat damage, slightly rotated (up to, say 
1 degree) due to differences in insertion into a reader, and can have slight differences in true 
15 data rate due to fluctuations in the speed of the reader motor 37. These changes will cause 

columns of data from the card not to be read as corresponding columns of pixel data. A 1 
degree rotation in the photograph 9 can cause the pixels from a column on the photograph to 
be read as pixels across approximately 305 columns. 

Finally, the photograph 9 should be read in a reasonable amount of time with respect to 
20 the human operator. The data on the photograph covers most of the surface, so timing 

concerns can be limited to the data itself. A reading time of approximately 3 seconds is 
adequate. 

If the photograph is loaded in 3 seconds, then all 30,500 columns of pixel data must be 
read from the CCD 34 in 3 seconds, i.e. 10,167 columns per second. Therefore the time 
25 available to read one column is 0.0000984 seconds. Pixel data can be written to a DRAM, for 

example of 8Mbytes one column at a time, completely independently from any processes that 
are reading the pixel data. 

The time to write one column of data to DRAM is reduced by using a number of cache 
lines, for example, 8 cache lines. If 4 lines were written out at one time, 4 banks of DRAM 
30 can be written to independently, and thus overlap latency reduced. 

DRAM Size 

The amount of memory required for reading and decoding of the encoded data is 
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ideally minimized. The typical placement of a reader is in an embedded system where 
memory resources are limited, for example as a feature of an Artcam as described in USSN 
09/1 12,781 (Docket No. DOT01US) or USSN 09/1 12,785 (Docket No. ART29US) . This is 
made more problematic by the effects of rotation as the more the photograph is rotated, the 
5 more scanlines are required to effectively recover original IR dots. 

There is a trade-off between algorithmic complexity, user perceived delays, robustness, 
and memory usage. One of the simplest reader algorithms would be to simply scan the whole 
photograph and then to process the whole data without real-time constraints. Not only would 
this require huge reserves of memory, it would take longer than a reader algorithm that 
1 0 occurred concurrently with the reading process. 

The actual amount of memory required for reading and decoding a photograph is twice 
the amount of space required to hold the encoded data, together with a small amount of scratch 
space ( 1 -2Mbyte). 

15 Decoding the data 

A simple look at the data sizes shows the impossibility of fitting the process into, for 
example, 8MB of memory for example, as used in the applicant's Artcard reader of USSN 
09/112,781 (Docket No. DOT01US) if the entire pixel data (560 MB if each bit is read as a 
3x3 array) as read by the linear CCD 34 is kept. For this reason, the reading of the linear CCD, 

20 decoding of the bitmap, and the un-bitmap process should take place in real- time (while the 

photograph 9 is traveling past the linear CCD 34), and these processes must effectively work 
without having entire data stores available. 

The unscrambling process requires two sets of 8MB areas of memory since 
unscrambling cannot occur in place. 

25 It is assumed here that the data was encoded using the Artcard format as described in 

USSN 09/112,781 (Docket No. DOT01US) or USSN 09/112,785 (Docket No. ART29US) 
with a checkerboard modulation. In the Artcard format, the data is printed in a continuous 
data area the start and end of which is marked by targets, for example 16 targets for a card of 
55mm x 85mm, each target having a white dot in the centre of an array of 3 1 x 3 1 black dots 

30 with the data beginning 24 dots from that central dot. For a card of 4" x 6" (102mm x 

1 52mm) size, 32 similar targets may be used. Alternatively, the data may have been recorded 
in the "alternative Artcard" format which is equally disclosed in USSN 09/1 12,785 (Docket 
No. ART29US) ; or in USSN 09 /693.471 (Docket No. ART80US) , USSN 
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09 /693.083- (Docket No, ART81USV USSN 09 /693.134 - (Docket No. 

ART82US) . In this format, data is arranged in data blocks having specific characteristics 
wherein the data blocks are locatable by a distinctive set of targets. 

Turning now to Fig. 6, there is shown a flowchart 220 of the steps necessary to decode 
5 the data. These steps include reading in the photographic data 221, decoding the read data to 

produce corresponding encoded XORed scrambled bitmap data 223. Next a checkerboard 
XOR is applied to the data to produce encoded scrambled data 224. This data is then 
unscrambled 227 to produce data 225 before this data is subjected to Reed-Solomon decoding 
to produce the original raw data 226. Alternatively, unscrambling and XOR process can take 

10 place together, not requiring a separate pass of the data. Each of the above steps is discussed 
in detail in the applicant's applications USSN 09/1 12,781 (Docket No. DOT01US) or USSN 
09/1 12,785 (Docket No. ART29US) . As noted previously with reference to Fig. 5, the process 
of scanning data therefore, has 4 phases, the first 2 of which are time-critical, and must take 
place while pixel data is being read from the CCD. 

1 5 The four phases are described in more detail as follows. 

Phase 1. 

As the photograph 9 moves past the CCD 34 the start of the data area must be detected 
by robustly detecting special targets on the photograph to the left of the data area. If these 
cannot be detected, the photograph is rejected as invalid. The detection must occur in real- 

20 time, while the photograph 9 is moving past the CCD 34. 

If necessary, rotation invariance can be provided. In this case, the targets, as described 
in applicant's USSN 09/1 12,781 (Docket No. DOT01US) or USSN 09/1 12,785 (Docket No. 
ART29US) , are repeated on the right side of the photograph, but relative to the bottom right 
comer instead of the top corner. In this way the targets end up in the correct orientation if the 

25 card is inserted the 6t wrong" way. Phase 3 below can be altered to detect the orientation of the 

data, and account for the potential rotation. 
Phase 2. 

Once the data area has been determined, the main read process begins, placing pixel 
data from the CCD into a 'data window', detecting bits from this window, assembling the 
30 detected bits into bytes, and constructing a byte-image in DRAM. This must all be done while 

the photograph is moving past the CCD. 
Phase 3. 

Once all the pixels have been read from the data area, the motor 37 can be stopped, and 
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the byte image descrambled and XORed. Although not requiring real-time performance, the 
process should be fast enough not to annoy the human operator. The process must take 8 MB 
of scrambled bit-image and write the unscrambled/XORed bit-image to a separate 8MB 
image. 
5 Phase 4. 

The final phase in the read process is the Reed-Solomon decoding process, where the 
8MB bit-image is decoded into a 4MB valid image data area. Again, while not requiring real- 
time performance it is still necessary to decode quickly with regard to the human operator. If 
the decode process is valid, the card is marked as valid. If the decode failed, any duplicates of 
10 data in the bit-image are attempted to be decoded, a process that is repeated until success or 

until there are no more duplicate images of the data in the bit image. 

The four phase process described requires 18MB of DRAM. 8MB is reserved for 
Phase 2 output, and 2MB is reserved for scratch data during phases 1 and 2. 

A description of the actual operation of each phase is provided in greater detail in 
15 USSN 09/1 12,781 (Docket No. DOT01US) and USSN 09/1 12,785 (Docket No. ART29US) 

for a data card 55mm x 85mm and storing 2MBytes of data. 

If the data was encoded and printed on the photograph, using the "alternative Artcard" 
format, such as described in USSN 09 /693,471 (Docket Nos. ART80US) , USSN 

09 /693^83— (Docket No. ARTS 1 US) or USSN 09 /693.134 — (D eeket 

20 No. ART82US) , then the procedure for reading and recovering the data is substantially as 

described in applicant's applications USSN 09/112,781 Pocket No. DOT01US) or USSN 
09/1 12,785 (Docket No. ART29US) . 

Print Out Decoded Data 

25 Once the data has been recovered, the image, the image as transformed by the encoded 

image processing program or either of these, depending on whether the data recorded on the 
photograph is, for example, as disclosed in applicant's co-pending applications USSN 
09 /693.471 (Docket No. ART80US) , USSN 09 /693.083- (Docket No. 

ARTS 1 US) or USSN 09 /693 J 34 (Docket No. ART82USV can be printed out using 

30 an ink jet printhead of the required characteristics. If only the image is to be printed a 3-ink 

ink jet printhead will suffice. If the image and the encoded data is to be printed then an at least 
4-ink ink jet printhead would be necessary. 

If the data can be stored either in the printer or in a RAM area of the processor which 
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decodes the encoded data then the printer can be provided with means for enabling copies of 
the image to be printed as desired, for example dedicated switches or at least a numeric 
keypad. Alternatively, if a number of copies is required, the photograph may be passed 
repeatedly through the scanner. 

The foregoing description has been limited to specific embodiments of this 
invention. It will be apparent, however, that variations and modifications may be made to 
the invention, with the attainment of some or all of the advantages of the invention. For 
example, it will be appreciated that the invention may be embodied in either hardware or 
software in a suitably programmed digital data processing system, both of which are readily 
accomplished by those of ordinary skill in the respective arts. Therefore, it is the object of 
the appended claims to cover all such variations and modifications as come within the true 
spirit and scope of the invention. 



